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Abstract 

This paper studies the capacity of a class of discrete memoryless interference channels where inter- 
ference is defined analogous to that of Gaussian interference channel with one-sided weak interference. 
The sum-rate capacity of this class of channels is determined. As with the Gaussian case, the sum-rate 
capacity is achieved by letting the transceiver pair subject to interference communicate at a rate such that 
its message can be decoded at the unintended receiver using single user detection. It is also established 
that this class of discrete memoryless interference channels is equivalent in capacity region to certain 
degraded interference channels. This allows the construction of capacity outer-bounds using the capacity 
regions of associated degraded broadcast channels. The same technique is then used to determine the 
sum-rate capacity of discrete memoryless interference channels with mixed interference as defined in the 
paper. The obtained capacity bounds and sum-rate capacities are used to resolve the capacities of several 
new discrete memoryless interference channels. 

I. Introduction 

The interference channel (IC) models the situation where the transmitters communicate with their 
intended receivers while generating interference to unintended receivers. Despite decades of intense 
research, the capacity region of IC remains unknown except for a few special cases. These include 
interference channels with strong and very strong interference [l]-[5]; classes of deterministic and semi- 
deterministic ICs [6], [7]; and classes of discrete degraded ICs [8], [9]. 

There exists a strong parallel, both in terms of capacity region and capacity achieving encoding schemes, 
between two classes of interference channels: the discrete memoryless interference channel (DMIC) and 
the Gaussian interference channel (GIC). 
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A DMIC as described in II-A is characterized by its discrete input and output alphabets as well as 
the channel transition probability p{yiy 2 \x\x 2 ) . On the other hand, a GIC, in its standard form, has its 
outputs expressed as 



Y 1 = X 1 + aX 2 + Z 1 , 
Y 2 = bX 1 +X 2 + Z 2 , 



(1) 
(2) 



where a and b are the channel coefficients corresponding to the interference links, Xi and Yi are the 
transmitted and received signals, and the channel input sequence Xn,Xi 2 , ■ ■ ■ , Xi n is subject to the power 

n 

constraint £ [Xfj] < nPi, i = 1, 2, Z\ and Z 2 are Gaussian noises with zero mean and unit variance, 

independent of X\,X 2 . We describe below parallel capacity results between the two types of interference 
channels. 

Very Strong Interference 

Carleial [1] defined the very strong interference for a GIC in standard form as 

„2 



> 1 + Pi, 

> I + P2 



(3) 
(4) 



in Eqs. (1) and (2). In this case, interference can be decoded first and subtracted from the 
received signals, resulting in interference-free signals for the intended receivers. This sequential 
decoding scheme under the very strong interference condition achieves the following rate region 

< Ri < ilog(l + i>i) 
< R 2 < |log(l + P 2 ) 
This rate region is also a natural outer bound, hence is indeed the capacity region of the GIC 
under very strong interference, and is achieved with Gaussian input. For Gaussian input, the 
condition in (3) and (4) implies that 



, R 2 



(5) 



J(X i; Yi|X 2 ) < J(X i; Y 2 ) 
I^YzlXi) < I(X 2 ;Y 1 ) 



(6) 
(7) 



Sato in [2] imposes the above condition on a DMIC with the additional requirement that it hold 
for all product input and obtained the capacity region for a DMIC with very strong interference 
to be 

' 0<i?i </(Xi;Yi|X 2j 
< R 2 < J(X 2 ;F 2 |Xi; 



K= I (Ri,R 2 ) 
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Sato alluded in [2] that (6) and (7) hold for all product input may be too restrictive, i.e., "This 
is a sufficient condition for the coincidence of the bounds, but may not be necessary." In [10], 
it was established indeed that for a DMIC, the very strong interference can be relaxed to be 
such that conditions (6) and (7) need to be satisfied only for input distribution achieving the 
boundary points of the capacity region. This simple generalization broadens the class of DMIC 
with very strong interference and is also consistent with the GIC counterpart - it was shown in 
[10] that (6) and (7) may be violated with non-Gaussian input even if (3) and (4) are satisfied. 
Strong Interference 

Han and Kobayashi [4] and Sato [3] independently obtained the capacity region of a GIC under 
strong interference, i.e., when, a > 1 and b > 1 in Eqs. (1) and (2) as the following 

< Ri < ilog(l + Pi) 



p(P,p 2 ) = { 



(Pi, R 2 



< R 2 < ±log(l + P 2 ) 



(8) 



Pi + R 2 < min{i log(l + Pi + aP 2 ), \ log(l + bP x + P 2 )} J 
Clearly, this capacity region coincides with that of a compound multiple-access channel (MAC) 
where both receivers are expected to decode both messages. Notice that in the case of a 2 > 1+Pi 
and b 2 > 1 + P 2 , the sum rate bound in (8) is inactive thus (8) includes (5) as its special case. 
Nevertheless, to achieve (8) under the strong interference condition, joint decoding instead of 
sequential decoding is required at each receiver. 

In [3] Sato also conjectured the condition as well as the capacity region of DMICs under 
strong interfernce, which was eventually proved by Costa and El Gamal in 1987 [5]. The strong 
interference for a DMIC is referred to the condition that the inputs X\ and X 2 and corresponding 
outputs Y\ and Y 2 satisfy 



I{X X ;Y X \X 2 ) </(Xi;y 2 |X 2 ), 
I{X 2 ;Y 2 \X X ) <1{X 2 -Y X \X X ) 



(9) 
(10) 



for all product probability distribution on X\ x X 2 . 

The corresponding capacity region was shown to be the union of the rate pairs (Pi,P 2 ) 
satisfying 

< Pi < /(Xi;Yi|X 2 Q) 

o < R 2 < /(x 2; y 2 |^i<3) 

Pi + P 2 < mm{I(X 1 X 2 ;Y 1 \Q),I(X 1 X 2 ;Y 2 \Q)} 



K 



(Pi, P 2 



(11) 
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where Q is a time-sharing parameter of cardinality 4, and the union is over all probability 
distributions of the form p(q)p(xi\q)p{x2\q)p{yiy2\x\X2), with p{yiy2\x\X2) specified by the 
channel. It was established in [10] that the condition in (6) and (7) are consistent with the 
strong interference condition for a GIC. That is, for a GIC in stardard form, a > 1 and b > 1 
is equivalent to (6) and (7) for all product input distribution for a GIC. 
While the capacity region for the general GIC remains unknown, there have been recent progresses in 
characterizing the sum-rate capacity of certain GICs, including: GICs with one-sided weak interference 
[11], noisy interference [12]— [14], and mixed interference [13]. This paper attempts to derive parallel 
sum-rate capacity results for DMICs with weak one-sided and mixed inference which complement 
existing parallel results in the strong interference regime. Our definitions of one-sided, weak, or mixed 
interference are motivated by properties associated with the corresponding Gaussian channels. Some of 
those definitions are intimately related to those introduced in [15] which studies the capacity region of 
the discrete memoryless Z-channel. 

The rest of the paper is organized as follows. Section II presents the channel model and relevant 
previous results. Section III defines the DMIC with one-sided weak interference and derives its sum-rate 
capacity. We refer to those DMICs with one-sided interference as DMZIC (i.e., discrete memoryless Z 
interference channel) for ease of presentation. The equivalence between the DMIC with weak one-sided 
interference and the discrete degraded interference channel (DMDIC) is established which allows one to 
construct a capacity outer-bound for the DMZIC using the capacity region of the associated degraded 
broadcast channel. Several specific DMICs are studied in Section III whose capacities or capacity bounds 
are obtained. Section IV defines DMICs with mixed interference and derives the sum capapcity for this 
class of channels. Section V concludes this paper. 

II. Preliminaries 

A. Discrete Memoryless Interference Channels 

A discrete interference channel is specified by its input alphabets X\ and X2, output alphabets 3^1 and 
3^, and the channel transition matrices 




(12) 




(13) 
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The discrete IC is said to be memoryless if 

n 

p(yMK^) = \\_p{yuy2i\xiix 2 i). (14) 

i=l 

A (n, 2 niJl , 2 nR2 , Ai, A2) cocfe for a DMIC with independent information consists of two message sets 
Mi = {1, 2, • • • , 2 nRl } and M 2 = {1, 2, • • • , 2 nR2 } for senders 1 and 2 respectively, two encoding 
functions 

and two decoding functions 

The average probabilities of error are defined as 

Xi= ]M~J\mJ J2 Pr{(pi(y 1 )^wi\Wi = w 1 ,W2 = w 2 }, 

' wi — 1 W2 — 1 

2 nRi 2 nR 2 

A2 " |X |LM I 51 Pr {^2(y2) ^ = w 1 ,W 2 = w 2 }- 

' '< ' Wi—1 W2 — 1 

A rate pair (R\ , R2) is said to be achievable for a DMIC if there exist a sequence of (2 nRl , 2 nR - 2 , re, Ai , A2) 
codes such that Ai, A2 — > as n — > 00. The capacity region of a DMIC is defined as the closure of the 
set of all achievable rate pairs. 

B. Existing Results for GICs 

Sason [11] proved that the sum-rate capacity for GICs with one-sided weak interference (a < 1 and 
b = in Eqs. (1) and (2)) is 



Csum = ilog(l + P2) + ^log(l + T ^) 



This sum-rate capacity is achieved by letting the transceiver pair subject to interference communicate 
at a rate such that its message can be decoded at the unintended receiver using single user detection, 
and the interference-free transceiver pair communicate at the maximum rate. The GIC with one-sided 
interference is often referred to as the Gaussian Z interference channel (GZIC). 

Motahari and Khandani [13] established that the sum-rate capacity for GICs with mixed interference 
(a < 1 and b > 1) is 

C sum = - {i log (l + , i log (l + J^L.) } + i log(l + ft). 



March 11, 2013 



DRAFT 



6 



To achieve this sum-rate capacity, the transceiver pair subject to strong interference communicates at a 
rate as if there is no interference, while the transceiver pair subject to weak interference communnicates 
at a rate such that its message can be decoded at both receivers using single user detection. We attempt 
to extend these results to DMICs with appropriately defined one-sided weak interference and mixed 
interference. This extension will in turn allow us to solve the capacity of new DMICs. 

C. Useful Properties of Markov Chains 

The following properties of Markov chains are useful throughout the paper [16]: 

. Decomposition: X — Y — ZW => X -Y - Z; 

. Weak Union: X — Y — ZW => X - YW - Z; 

. Contraction: (X - Y - Z) and (X - YZ - W) => X - Y - ZW . 

III. The DMIC with One-sided Weak Interference 
A. Channel Model and Sum Rate Capacity 

Definition I: For the DMIC defined in Section II-A, if for all x±, x 2 , y 2 , 

P{V2\X2) = p{y2\XlX 2 ), (15) 

or equivalently, 

X 1 -X 2 -Y 2 (16) 

forms a Markov chain, this DMIC is said to have one-sided interference. 

Clearly, the Markov chain condition (16) holds for the GIC with b = in (2). As with the Gaussian 
case, we refer to the DMIC with one-sided interference as simply discrete memoryless Z interference 
channel (DMZIC). From the definition, it follows that X\ and Y 2 are independent for all input distribution 

p{xi)p{x 2 ). 

To define DMZIC with weak interference, we first revisit some properties of Gaussian ZIC with weak 
interference. It is straightforward to show that a Gaussian ZIC with weak interference is equivalent in its 
capacity region to a degraded Gaussian ZIC satisfying the Markov chain 

X 2 -(X 1 ,Y 2 )-Y 1 . (17) 

The proof is similar to that in [15] for a Gaussian Z channel instead of a Gaussian Z interference channel. 
This motivates us to define DMZIC with weak interference as follows. 
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Definition 2: A DMZIC is said to have weak interference if the channel transition probability factorizes 

as 

p{yiy2\xix 2 ) = p{y2\x2)p' {yi\xiy 2 ), (18) 

for some p' (yi\x\y 2 ), or, equivalently, the channel is stochastically degraded. 

In the absence of receiver cooperation, a stochastically degraded interference channel is equivalent in 
its capacity to a physically degraded interference channel. As such, we will assume in the following that 
the channel is physically degraded, i.e., the DMZIC with weak interference admits the Markov chain 

X 2 -(X 1 ,Y 2 )-Y 1 . 

The channel transition probability p(yiy 2 \xix 2 ) for this class of channels factorizes as 

p(yiy2\xix 2 ) = p(y 2 \xix 2 )p(y 1 \x 1 x 2 y 2 ) 

= P{y2\x 2 )p{yi\x 1 y 2 ). (19) 

As a consequence, the following inequality holds 

IiUiY^yi^YxlXx), (20) 

for all input distributions p(x\)p{u)p{x 2 \u) . We note that this condition is indeed what is needed in 
establishing the sum-rate capacity of this channel and was used in [17] to define the weak interference 
for DMZIC. The definition used in this paper, while stronger than necessary, is much more intuitive and 
easier to verify. 

The above definition of weak interference leads to the following sum-rate capacity result. 
Theorem 1: The sum-rate capacity of a DMZIC with weak interference as defined above is 

C S um= max {I(X i; Y x ) + I(X 2 ; Y 2 )}. (21) 

p{x 1 )p{x 2 ) 

Proof: This sum-rate is achieved by two receivers decoding their own messages while treating any 
interference, if present, as noise. 
For the converse, we have 

n(Ri + R 2 ) - ne <I(X?; F") + 7(XJ; Y 2 n ) 



(b) 



J2 {H{Y u \Yt X ) - HiYulY^Xl 1 ) + H(Y 2l \Y^) - H(Y 2l \Y^ 1 X 2 1 )) 



(c) n 

<^2{H(Y li ) - H(Yu\Y^~ 1 X^Y 2 i ~ 1 ) + H{Y 2i \y;- 1 ) - H(Y 2l \Y 2 l - 1 X 2l )) 



i=l 



J2 (H(Y U ) - HiYulXfY*- 1 ) + I{X 2l -Y 2l \Ui)) 
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i H ( Y u) - H(Y li \X li Yt 1 )+I(X 2i ;Y 2i \U i )) 

i=i 

n 

= ^2(HUiX u ; Y u ) + I{X 2i ; Y 2l \U l )) 

4=1 

n 

= YJl{X Xi \ Y u ) + I(Ui;Y u \X u ) + I(X 2i ;Y 2i \Ui)) 
i=l 

(/) - 

i=l 
n 

i=l 
n 

( =^(/(x li; y l4 ) + /(x 2l ;r 2l )), 

i=l 

where C/j = for all i, (a) follows the Fano's Inequality, (b) is from the chain rule and the definition 
of mutual information, (c) is because of the fact that conditioning reduces entropy, and that is 
independent of any other random variables given X 2 i, (d) is due to the memory less property of the 
channel and the fact that Yu is independent of any other random variables given Xu and Y 2 %, then 
{X li ,Yu) — (X\~ l , Y 2 * -1 ) ~~ y i~ forms a Markov chain. By the weak union property, the Markov chain 
Y u - (Xf , y 2 i_1 ) - Yi~ l holds; (e) is because of the Markov chain (Xj -1 , XJ* ji+1 ) - Y^ -1 ) - Y^. 
This can be established using the independence graph [18]. Alternatively, we first note that the Markov 
chain 

(X{~\Xl i+l ,Yt l ) - (X u ,Y 2i ) - Y U 

holds, since given Xu and Yu, Yu is independent of X\~ , X™ i+1 , Y£~ . By the weak union property, 
the following Markov chain is obtained: 

(X[-\Xl l+l )-(X lu Y 2 l )-Yu. 

The independence between Y 2 and X™ gives the Markov chain 

(X{ \ X™ i+1 ) - X u - Y 2 l . 

The above two Markov chains lead to the following Markov chain: 

(X\-\Xl l+1 )-Xu-{Yu,Yi) 

by the contraction property. Again, using the weak union property and then the decomposition property, 
we obtain the Markov chain 

(X{-\Xl i+l )-{Xu,Y 2 l - l )-Yu 
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as desired. Since U{ and Xu are independent, then p(x\X2u) = p(xx)p(u,x 2 ), thus (/) comes from 
(20). Finally, (g) follows from the Markov chain Ui — X 2 i — Yn- Finally, by introducing a time-sharing 
random variable Q, one obtains 

R1 + R2 < I{X l -Y l \Q) + I(X 2 ;Y 2 \Q) + e 

< max {I(X 1 ;Y 1 ) + I(X 2 ;Y 2 )} + e. 

p{x 1 )p(x 2 ) 

m 

Remark 1: From the strong interference condition (10), it is perhaps tempted to define the condition 
for weak interference as 

I(X 2 ;Y 1 \X 1 ) <I(X 2 ;Y 2 ), (22) 

for all product input distribution on X\ x X 2 . Notice that the right-hand side is same as I(X2]Y2\Xi) 
given that this is one-sided interference channel. The Markov chain (17) is a sufficient, but not necessary, 
condition for the mutual information condition (22). An example is provided in Appendix zA such that 
the mutual information condition holds but the Markov chain is not valid. This is different from that 
of the Gaussian case; it can be shown that the coefficient a < 1 in a Gaussian ZIC is a sufficient and 
necessary condition for (22) to hold. It is yet unknown if condition (22) is sufficient for the sum-rate 
capacity result (21) to hold for the DMZIC. 

Remark 2: For a DMZIC with weak interference, an achievable rate region, C, is given by the set of 
all nonnegative rate pairs (Ri,R 2 ) that satisfy 

Rt < I{X^Y X \U 2 Q), (23) 

R 2 < I(X 2 ;Y 2 \Q), (24) 

R1 + R2 < I{U2X l -Y l \Q) + I{X 2 ;Y2\U2Q). (25) 

where the input distribution factorizes as: 

p(qu2X\X2) = p(q)p(xi\q)p(u2\q)p(x 2 \u 2 ,q). (26) 

Furthermore, the region remains invariant if we impose the constraints ||Q|| < 5, \\U2W < \\X 2 \\ +3. This 
can be readily obtained from the achievable rate region of the general two-user IC [4], [19]. In the next 
lemma, we provide a simpler description for the above achievable rate region. 

Lemma 1: The region C is equivalent to the set of all rate pairs (Ri,R 2 ) satisfying 

R t < I(Xi;Yi\U 2 Q), (27) 

R 2 < HU^YiQ) + I(X 2 ;Y 2 \U^Q). (28) 
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where the input distribution factorizes as (26). Furthermore, the region remains invariant if we impose 
the constraints ||Q|| < 4, ||Z4|| < II^H +3. 

Proof: Let E denote the set defined in the above lemma. The fact that E C C follows simply by 
setting U 2 = U2 and noticing that (23)-(25) imply (27) and (28). To prove that C C E, we first note that 
for a given p{qu 2 x\x 2 ), C is a pentagon with two extreme points in the first quadrant given by 

pi = (I(X 1] Y 1 \U 2 ,Q = q),I(U 2 ;Y 1 \Q = q)+I(X 2 ;Y 2 \U 2 ,Q = q)), (29) 
p 2 = (I(U 2 X 1 ;Y 1 \Q = q)-I(U 2 ;Y 2 \Q = q),I(X 2 ;Y 2 \Q = q)). (30) 

It suffices to show that, for any given p{qu 2 x\x 2 ) in (26), the corresponding p\ and p 2 , belongs to the 
set E, where 

That pi € E follows from setting U 2 = U' 2 . To show that p 2 6 E, we use the following inequality 

I(U 2 X 1 ;Y 1 \Q = q) - I(U 2 ;Y 2 \Q = q) = HjJ^Y^XxQ = q) - I(U 2 ;Y 2 \Q = q) + I(X l] Y l \Q = q) 

< I{X l ;Y l \Q = q) 

< I(X 1 ;Y 1 \U 2 ,Q = q). 

Hence, C C E. ■ 

B. Capacity Outer Bound for DMZIC with Weak Interference 

Costa proved in [20] that a GZIC with weak interference is equivalent in capacity region to a degraded 
GIC. As such, Sato's outer-bound on degraded GIC [21] applies to that of the GZIC with weak interfer- 
ence. Sato's outer-bound is in essence the capacity region of a related Gaussian broadcast channel, which 
is a natural outer-bound to the interference channel due to its implied transmitter cooperation. In this 
section, we use the same technique to obtain a capacity outer-bound for DMZIC with weak interference, 
i.e., that satisfies the Markov chain X 2 — (Xi,Y 2 ) — Y\. Specifically, for any such DMZIC with weak 
interference, one can find an equivalent (in capacity region) DMDIC whose capacity region is bounded 
by that of an associated degraded broadcast channel. 

Theorem 2: For a DMZIC that satisfies the Markov chain X 2 — X\Y 2 — Y\, the capacity region is 
outer-bounded by 

. . Ri < I(U; Yi), 

[p(w)p(xix 2 |i») ^ 2 - I{XiX2', Kj' I U) 

where XJ -X X X 2 -Y^-Y X forms a Markov chain and \\U\\ = min{pi||, ||3^||, ||<*i|| ■ ||^||}, and co{-} 
denotes the closure of the convex hull operation. 
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Proof: Suppose that the DMZIC with weak interference has inputs X\, X2 and outputs Y\, Yi 
respectively. Let us denote by X[, X' 2 and Y{, Y 2 the inputs and outputs of another DMIC with X[ = X\, 
X' 2 = X 2 , Y{ = Yi, and Y 2 ' to be a function of X 1 and Y 2 , denoted as Y 2 ' = f(X 1 ,Y 2 ) such that the 
Markov chain (X[,X 2 ) - Y 2 - Y{ holds. Thus, the DMIC specified by the input pair (X[,X 2 ), and the 
output pair (Y{, Y 2 ) is indeed a DMDIC. 

The proof that this DMDIC has the same capacity region as the specified DMZIC, and hence is outer- 
bounded by the associated broadcast channel follows in exactly the same fashion as Costa's proof for 
the Gaussian case [20], hence is omitted here. ■ 

Remark 3: A trivial choice of Y 2 is a bijection of X\ and Y 2 . It is easy to verify that the Markov chain 
(X[,X 2 ) — Y 2 — Y{ holds for such Y 2 . However, other Y 2 can be constructed, as long as the Markov 
chain (X[,X 2 ) — Y 2 — Y[ is satisfied. Nevertheless, the associated broadcast channels would have the 
same the capacity region. 

C. Examples 

Example 1: Consider a DMZIC with input and output alphabets X\ = X 2 = y\ = y 2 = {0, 1} and 
is defined by the equations: y\ = x\ • x 2 , IJ2 = Etkin and Ordentlich in [22] established the capacity 
region for this binary multiplier channel via a new outer-bounds derived in their paper. As this channel 
satisfies the weak interference condition in this paper, we can immediately get the sum-rate capacity to 

be max I{X\\Y\) + I{X 2 \ Y^). 

p(jBi)p(a!2) 

Example 2: Let X\ = X2 = y± = 3^2 = {0, 1} and 

Y X = X 1 ®Y 2 , 
Y 2 = X 2 (BZ, 

where © denotes the modulo 2 sum and Z ~ Bern(e). 

Clearly, the Markov chain X 2 — X\Y 2 — Y\ is satisfied. Let p = Pr(X 2 = 1). Then, 

I(X 2 ;Y 2 ) = h 2 (e(l-p) + (l-e)p)-h 2 (e), 
/(XxjYx) = H(Y 1 )-h 2 (e(l-p) + (l-e)p). 

The sum-rate capacity is 

C SU m= max {J(X i; Y 1 ) + I(X 2 - Y 2 )} = 1 - ^(e), 

p(x 1 )p(x 2 ) 
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which is achieved by any p(x\)p(x 2 ) such that H(Y\) = 1. Additionally, both points (0,1 — /12(e)) 
and (1 — /12(e), 0) are trivially achievable. Therefore, the capacity region of this channel is the triangle 
connecting the two rate pairs (0, 1 — /12(e) and (1 — /12(e), 0). 

This channel does not belong to any class of channels that have been studied in the literature. The 
property of H{Y\\X\) = H(Y 2 ) is similar to the deterministic interference channel definition [6]. 
However, Y 2 is not a deterministic function of X 2 . 

This channel is equivalent, in the capacity region, to the following interference channel: 

Yi = X 1 ®X 2 ®Z, 
Y 2 = X l @X 2 ®Z. 

This can be proved in a similar way to that used in [20] for proving the equivalence between the Gaussian 
ZIC and the Gaussian degraded IC. Notice that the capacity region of the discrete additive degraded IC is 
solved by Benzel in [8], the capacity region of the DMZIC can be obtained through the equivalent discrete 
additive degraded IC, i.e., the closure of the convex hull of all the nonnegative (Ri,R 2 ) satisfying the 
following inequalities: 

Ri<l(Xr,Y{), 

R 2 < I(X 2 ;Y 2 ), 

for all possible product input distribution on X\ x X 2 . 

Example 3: Let X\ = X 2 = ^i = y 2 = {0, 1} and 

Yi = X 1 -Y 2 , 
Y 2 = X 2 @Z. 

This channel is similar to Example 2 except that Y\ is replaced by an erasure channel. 

The Markov chain X 2 — X{Y 2 — Y\ holds and the capacity region of this channel can be obtained in a 
manner similar to that of [22]. We first upper-bound the two individual rates R\ and R 2 . From the proof 
of Theorem 1 , it is straightforward to obtain 

fli-d <I{UXr,Y x \Q) 
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where U is an auxiliary random variable satisfying p(ux±x 2 ) = p(x\)p(ux 2 ). For R 2 , 
n(R 2 -e 2 ) < I(X2;Y 2 n ) 

n 



i=l 



< J2(H(Y 2i )-H(Y 2i \X 2i )) 



i=l 



J2l(X 2i ;Y 2i ) 



i=l 



nI(X 2 ;Y 2 \Q). 



Let Pl>q = Pr(xi = 1|Q = q), p 2 , q = Pr(x 2 = 1\Q = q), p\ q = Pr(y 2 = 1|Q = q), r q = H(Y 2 \U,q), 
note that 

P 2 ,q=P2,q( 1 ~ £ ) + (1 -P2,g)e, 



and 



for each q. Then, 



r g < h 2 (p 2}q ), 



Ri-ei < IiUXx-Y^Q) 



q=l Xi=0 

IISII 

Y J [H(Y 1 \q)-p{x 1 = l\q)H(Y 2 \U,q)\ 

q=l 

IISII 

J^foj (Pl,qP 2 ,q I q) ~P{X1 = Mq)r q ] 
q=l 



and 



R 2 -e 2 < I(X 2 ;Y 2 \Q) 

= H(Y 2 \Q) - H(Y 2 \X 2 Q) 
= h 2 (pl q )-h 2 (e). 

Compared with the expressions in [22, Eqs. (15) and (16)], the only difference is the constant /12(e), 
which does not affect the optimization. Therefore, the optimization process there can be directly applied 
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here. It follows that the capacity region of this channel is the convex hull of 1Z', where 



U : R i ^ = h2(piP y2 )-pih 2 ( P y 2 ),R 2 < I(X 2 ;Y 2 ) = h 2 (p y2 ) - h 2 (e)} 

0<P1,P2<1 

where = e(l— p 2 )+(l— e)p2- Clearly, the sum-rate capacity is max { (pip y2 ) + (1 — Pi)h 2 (p y2 ) — h 2 (e)}. 
Example 4: = ||# 2 || = M = 2, ||^i|| = 3. 



PlP'2 



Y 2 



X\ © Y 2 , with probability 1-5 
e, with probability 5 



where V\ ~ Bern(e). Clearly, Y\ is the output of a erasure channel with input X\ © Y 2 and erasure 
proability S. Define Y 2 ' = Xi@Y 2 . Thus, the DMIC with inputs X\,X 2 and outputs Y\, Y 2 is a degraded 
DMIC. The capacity region of this degraded DMIC has been solved by Liu and Ulukus [9], and can be 
expressed as 

Ki = co\ (J ((R h R 2 ) :R 1 <I(X 1 ;Y 1 ),R 2 <I(X 2 ;Yi\X 1 ))[ . 

\ < p(x 1 )p(x 2 ) J 

The corresponding capacity region for the DMZIC is 

K z = co< |J ((R 1 ,R 2 ):R 1 <I(X 1 ;Y 1 ),R 2 <I(X 2 ;Y 2 )) 

K p(x 1 )p(x 2 ) 

That TZz being the capacity region comes from the fact that I(X 2 ]Y 2 \X\) = I(X 2 ;Y 2 ) while TZi is 
naturally an outer-bound. 

Example 5: Let H-^iH = \\X 2 1 1 = ||iVi|| = 1 1 3^2 1 1 = 2 and the channel transition probability be given by 

p(yiV2\xix 2 ) = p(y 2 \x 2 )p(yi\xiy 2 ), 
where p(y 2 \x 2 ) and p(yi\xiy 2 ) are specified in Table I. 

TABLE I 

Channel Transition Probabilities 



P{V2\X 2 ) 


2/2=0 


2/2 = 1 


p(yi|a5ijfe) 


J/i=0 


2/i = l 


X 2 =Q 


.1 


.9 


£i2/2 = 00 or 11 


.75 


.25 


X2 = 1 


.9 


.1 


£11/2 = 01 or 10 





1 



By Theorem 1, the sum-rate capacity is 



C sum = max /(Xi;Yi) + I(X 2 ;Y 2 )«.531. 

P(^l)p(^2) 
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In addition, a simple outer bound can be constructed as follows 

R x < 7(Xi;yi|Jf 2 ), 
R2 < I(X 2 ;Y 2 ), 
R1+R2 < I(X 1 ;Y 1 ) + I(X 2 ;Y 2 ). 
We now use Theorem 2 to obtain a new outer bound. Construct Y 2 ' as follows 

0, if xiy 2 = 00 or 11, 

1, otherwise. 
Then p(y' 2 \xix 2 ) is given in Table II. 

TABLE II 

P(Yi\X 1 X 2 ) 



Y' 



P(V2\X1X2) 


y'2^0 


2/2 = 1 


X1X2 = 00 


.1 


.9 


x 1 x 2 = 01 


.9 


.1 


X1X2 = 10 


.9 


.1 


X1X2 = 11 


.1 


.9 



(31) 
(32) 
(33) 



Using Theorem 2, the capacity region of the DMZIC is outer-bounded by that of the associated discrete 
memoryless degraded broadcast channel: 

' Ri<I(U;Y x ), 



TIob = CO < 
Let R 2 to be fixed at x, then 



(J (Ri,R2) 

< p(u)p(x 1 x 2 \u) 



R 2 <I(X l X 2 -Y^\U) 



maxi?! = max H(Y X ) - H(YA U) 

R 2 =x H(Yj\U)=x+h 3 (.l) 

< logd^D-M^ + M-i)). 

where /t(-) is a function defined by Witsenhausen and Wyner [23]. Fig. 1 depicts the new outer-bound 
specified by 



K'ob = {{Ri,R2)\Ri < log \yi\-f T (x + h 2 (.l)),R 2 <x}. 
This new outer-bound significantly improves upon the simple outer-bound (31)-(33). 



(34) 
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0.02 0.04 0.06 0.08 0.1 0.12 0.14 0.16 0.18 0.2 

Ri 



Fig. 1. Comparison of the outer-bounds. 



IV. The DMIC with Mixed Interference 

For the GIC with mixed interference (a < 1 and b > 1 in (1) and (2)), one can construct an equivalent 
GIC with degradedness defined by the Markov chain X 2 — {X\, Y 2 ) — Y\\ 

Y{ = (1 -ab)X 1 + aY 2 + Z[, 

Y 2 = bX 1 + X 2 + Z 2 , 

where Z[ ~ M(0, 1 — a 2 ). This motivates us to define DMIC with mixed interference in an analogous 
fashion, which leads directly to its sum-rate capacity described in Theorem 3. 

Definition 3: A DMIC is said to have mixed interference if it satisfies the Markov chain 

X 2 -(X 1 ,Y 2 )-Y 1 (35) 

and 

/(^nl-Xa) <I(X i; Y 2 \X 2 ) (36) 

for all possible product distributions on X\ x X 2 . 

Theorem 3: The sum-rate capacity of a DMIC with mixed interference, i.e., one that satisfies the two 
conditions (35) and (36), is 

Gmm= max {I{X 2 ; Y 2 \X X ) + min{7(X i; Y t ), I(X V , Y 2 )}} . (37) 

p(x 1 )p(x 2 ) 
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Proof: In order to achieve this sum rate, user 1 transmits its message at a rate such that both receivers 
can decode it by treating the signal from user 2 as noise; user 2 transmits at the interference-free rate 
since receiver 2 is able to subtract the interference from user X\. 

For the converse, we prove the following two sum-rate bounds separately: 

n 

n(R 1 +R 2 ) < ^/(X H X 2i ;Y 2i ), (38) 

i=l 
n 

n{R 1 +R 2 ) < ^7(X 1 i;y li )+/(^2i;^|X li ). (39) 

i=l 

For (38), the derivation follows the same steps as Costa and El Gamal's result [5]. For (39), we apply 
similar techniques used in the proof of Theorem 1. First, notice that (35) implies 

iiu-^x^ <i(u; y 2 \x x ) (40) 

for any U whose joint distribution with Xi,X2,Yi,Yi is 

p(u,xx,x 2 ,yi,y2) = p(u)p(x 1 X2\u)p(yiy2\xxx 2 ). (41) 

Therefore, 

n{Rx + R 2 ) - ne <I(X?; Y?) + J(X 2 "; Y?\X?) 

n 

= '%2(H(Y 1 i\Y*- 1 ) - HiYulY^X^) + H^Y^X?) - H(Y 2i \Yt 1 X^X^)) 

i=l 

(b) n 

<Y, (H{Y U ) - HiYulYj^XZYj- 1 ) + H(Y 2i \U i X li ) - H{Y 2t \X 2l XuU l )) 

i=l 
n 

■ ^(liUiX^Yu) + IiX^Y^ptXu)) 

i=l 
n 

= Y,(I(X li ;Y li ) + I(Ui-, Y U \X U ) + I{X 2i ;Y 2i \UiX u )) 

i=l 

(c) n 

<^(7(X li; Y u ) + I(Ui; Y 2i \X u ) + I{X 2i -Y 2i \UiX u )) 
i=i 

n 

= ^(I(1h; Y u ) + I{X 2i ; Y M \X U )), 
»=i 

where (a) is because of the independence between X™ and XV; ; (b) is from the fact that conditioning 
reduces entropy and by defining Ui = (X 1 ~ 1 Xf i+1 , Y^ 1 ); (c) is from (40); and (d) is because of the 
memoryless property of the channel and (41). From (38) and (39), we have 

n 

Rl+R 2 < ^min{/(X l4 X 2l ;y 2t ),/(X l4 ;r H )+/(X 2? ;;y 2t |X l4 )}. (42) 
Finnally, by introducing the time-sharing random variable Q, one obtains (37) as desired. ■ 
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We give the following example where the obtained sum-rate capacity helps determine the capacity 

region of a DMIC. 

Example 6: Consider the following deterministic channel: 

Yi = X 1 >X 2t 
Y 2 = X x ®X 2l 

where the input and output alphabets X\ = X 2 = = 3^2 = {0, 1}. Notice that this channel does not 
satisfy the condition of the deterministic interference channel in [6]. Obviously, the Markov chain (35) 
holds. Moreover, 

I(X 1 ;Y 1 \X 2 )=H(Y 1 \X 2 )=p(x 2 = l)iT(*i), 
I(X 1 ;Y 2 \X 2 )=H(Y 2 \X 2 ) = H{X X ). 

Therefore, 

HX Vi Yx\X 2 )<I{X v> Y 2 \X 2 \ 

for all possible input product distributions on X\ x X 2 . Thus, this is a DMIC with mixed interference. 
On applying Theorem 3, we compute the sum-rate capacity to be 

Csum = max \oAvl{I{X x X 2 ; Y 2 ), I(X i; Y x ) + I(X 2 ; Y^))} 

p{x 1 )p{x 2 ) 

= 1. 

Given that (1,0) and (0, 1) are both trivially achievable, the above sum-rate capacity leads to the capacity 
region for this DMIC to be {{R x , R 2 ) : R\ + R 2 < 1}- 

V. Conclusion 

In this paper, we have derived the sum-rate capacity for a class of discrete memoryless interference 
channels whose channel property resembles that of the Gaussian interference channel with one-sided and 
weak interference. Capacity outer bounds are also derived for this class of channels. The same technique 
is then applied to obtain the sum-rate capacity of discrete memoryless interference channels with mixed 
interference. For both cases, the capacity expressions as well as the encoding schemes that achieve the 
sum-rate capacity are analogous to the Gaussian interference channel counterpart. These results allow us 
to obtain capacity results for several new discrete memoryless interference channels. 
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Appendix 

A. Counter Example for the Equivalence between the Two Different Conditions 

This example explains that a DMZIC that satisfies the mutual information condition (22) does not 
necessarily imply the Markov chain relationship (17). 

Let fij represent p(y 1 = l\xi = i,x 2 = j), gj represent p(y 2 = l\x 2 = j), Pi = Pr{X« = 1}, and 
pi = 1 — pi € {0, 1}). From the mutual information condition (22) 

I(X 2 ;Y 2 ) > I(X 2 ;Y 1 \X 1 ), 

we have 

H(Y 2 ) - H(Y 2 \X 2 ) > H(Y 1 \X 1 )-H(Y 1 \X 1 ,X 2 ) 

h 2 (p 2 go +P2gi) ~P2h 2 (gi) -p 2 h 2 (ga) > pih 2 (p 2 foo + P2/01) +pih 2 (p 2 fxo +p 2 fn) 

-pip 2 h 2 (f 00 ) -pip 2 h 2 (f 01 ) -pip 2 h 2 (f w ) -pip 2 h 2 (fn) 

Upon obtaining the above inequality, one can make specific choices of {fij} and {gj} to make the above 
inequality hold for all possible p\ and p 2 range from to 1. For example, it is easy to verify that a valid 
choice is 

/oo = -1) /01 = -3, /10 = -5, /h = .25, 
go = -l,gi = -5. 

In the following, we prove by contradiction that this channel does not satisfy the markov chain condition 
(17). 

Suppose that the markov chain (17) is satisfied, 

p(yi\xix 2 y 2 ) =p{y\\x x y 2 ). 

Then we would have, 

p{yi\x\x 2 ) = ^p(yiy2|xix 2 ) = 'Yl l p(y 2 \x 2 )p{yi\xiy 2 ). 

S/2 U2 
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Solving this equation, we get 

p(yi = = 1,2/2 = 1) = -t^i 

lb 

which contradicts the fact that channel transit probability can never be negative. 
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